WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 6 : 
G06F 15/163 



Al 



(11) International Publication Number: WO 99/39277 

(43) International Publication Date: 5 August 1999 (05.08.99) 



(21) International Application Number: PCT/US98/24572 

(22) International Filing Date: 17 November 1998 (17.1 1 .98) 



(30) Priority Data: 
09/015,577 



29 January 1998 (29.01.98) 



US 



(71) Applicant (for all designated States except US): INTERVAL 

RESEARCH CORPORATION fUS/US]; Building C, 1801 
Page Mill Road, Palo Alto, CA 94304 (US). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): VAN ALLEN, Philip, A. 
[US/US]; 97 Elsie Street, San Francisco, CA 941 10 (US). 
CARRYER, J., Edward [US/US]; 16 Peter Coutts Circle, 
Stanford, CA 94309 (US). 

(74) Agent: COLEMAN, Brian, R.; Hickman & Martine, LLP, P.O. 
Box 52037, Palo Alto, CA 94303-0746 (US). 



(81) Designated States: AL, AM, AT, AU, AZ, BA, BB, BG, BR, 
BY, CA, CH, CN. CU, CZ, DE, DK, EE, ES, Fi, GB, GE, 
GH, GM, HR, HU, ID, IL, IS, JP, KE, KG, KP, KR, KZ, 
LC, LK, LR, LS, LT, LU, LV, MD, MG, MK, MN, MW, 
MX, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SL, 
TJ, TM. TR, TT, UA, UG, US, UZ, VN, YU. ZW f ARIPO 
patent (GH, GM, KE, LS. MW, SD. SZ. UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH. CY, DE, DK, ES. FI, FR, GB. GR, 
IE. IT, LU, MC, NL, PT, SE), OAPI patent (BF. BJ, CF, 
CG, CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 



Published 

With international search report. 



BEST AVAILABLE COPY 



(54) Title: METHODS AND SYSTEMS FOR PROVIDING CONTENT THROUGH INDIRECTIONS 



500 




(57) Abstract 

The present invention teaches a variety of computer interface methods and systems (500) for providing content to a user through an 
indirection. One interface system has an encoded physical medium (510), a sensor (512), a network device (514), a routing server (516) 
and a content server (518). The encoded physical medium has at least one indirection hotspot (530) with a content ID encoded therein. The 
sensor (512) decodes then transmits the decoded content ID to a network device (514). The network device (514) transmits the decoded ID 
to the routing server (516). The routing server (516) responds to the receipt of the content ID (which essentially is a request for content) by 
redirecting the request to a given content address for locating content on content server (518) corresponding to the given content ID stored 
in a database (540). 
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METHODS AND SYSTEMS FOR PROVIDING CONTENT THROUGH 

INDIRECTIONS 



Background of the Invention 

This invention relates generally to computer interfaces. More specifically, 
the present invention discloses a variety of computer interfaces that provide 
content by way of indirection. Preferred embodiments use encoded physical 
mediums including at least one region having an indirection encoded therein. 
The present invention also teaches data-linked physical mediums that provide 
users intuitive access to multimedia information that may be stored remotely. 

People are constantly interacting with computerized systems, from the 
trivial (e.g., the computerized toaster or the remote control television) to the 
exceedingly complex (e.g., telecommunications systems and the Internet). An 
advantage of computerization is that such systems provide flexibility and power 
to their users. However, the price that must be paid for this power and flexibility 
is, typically, an increase in the difficulty of the human/machine interface. 

A fundamental reason for this problem is that computers operate on 
principles based on the abstract concepts of mathematics and logic, while humans 
tend to think in a more spatial manner. Often people are more comfortable with 
physical, three-dimensional objects than they are with the abstractions of the 
computer world. In short, the power and flexibility provided by the computer 
and related electronic technology are inherently limited by the ability of the 
human user to control these devices. Since people do not think like computers, 
metaphors are adopted to permit people to effectively communicate with 
computers. In general, better metaphors permit more efficient and medium 
independent communications between people and computers. The better 
metaphor will provide the user a natural and intuitive interface with the computer 
without sacrificing the computer's potential. 

There are, of course, a number of computer interfaces which allow users, 
with varying degrees of comfort and ease, to interact with computers. For 
example, keyboards, computer mice, joysticks, etc. allow users to physically 
manipulate a three-dimensional object to create an input into a computer system. 
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However, these computer interfaces are quite artificial in nature, and tend to 
require a substantial investment in training to be used efficiently. 

Progress has been made in improving the computer interface with the 
graphical user interface (GUI). With a GUI, icons that represent physical objects 
are displayed on a computer screen. For example, a document file may look like 
a page of a document, a directory file might look like a file folder, and an icon of 
a trash can may be used for disposing of documents and files. In other words, 
GUIs use "metaphors" where a graphical icon represents a physical object 
familiar to users. This makes GUIs easier for most people to use. GUIs were 
pioneered at such places as Xerox PARC of Palo Alto, California and Apple 
Computer, Inc. of Cupertino, California. The GUI is also often commonly used 
with UNIX™ based systems, and is rapidly becoming a standard in the PC/MS- 
DOS world with the Windows™ operating system provided by Microsoft 
Corporation of Redmond, Washington. 

While GUIs are a major advance in computer interfaces, they nonetheless 
present a user with a learning curve due to their still limited metaphor. In other 
words, an icon can only represent a physical object; it is not itself a physical 
object. It would be ideal if the computer interface was embodied in a physical 
medium which could convey a familiar meaning, one perhaps relevant to the task 
at hand. While progress has been made towards achieving such a goal, many 
roadblocks yet remain. For example, assuming that for a given application one 
has selected a physical medium for use as a computer interface, the information 
necessary to support the computer interface must still be encoded within the 
physical medium. Additionally, techniques must be developed for linking such 
interfaces with the vast wealth of information available from remote sources 
using computer networks like the Internet. 

Redford et al.'s U.S. Patent Serial No. 5,634,265, entitled "PRINTED 
PUBLICATION REMOTE CONTROL FOR ACCESSING INTERACTIVE 
MEDIA," filed July 1, 1994, describes one rudimentary mechanism for encoding 
information within a physical medium. Redford describes the use of a printed 
publication such as a book being constructed to include a storage media, a data 
button, and remote control circuitry. The button is physically attached to the 
printed publication and when activated by a user, data from the storage media can 
initiate local feedback at the printed publication and the remote control can 
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transmit a control message to a remote computer system which in turn performs 
some desired operation. 

While strides have been made in attempting to improve computer 
interfaces, there is still progress to be made in this field. Ultimately, the interface 
itself should disappear from the conscious thought of users so that they can 
intuitively accomplish their goals without concern to the mechanics of the 
interface or the underlying operation of the computerized system. 
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Summary of the Invention 

One embodiment of the present invention teaches an interface system for 
providing content to a user via a computer network. The interface system has a 
routing server that maintains a database storing information regarding content 
5 addresses and content identification numbers (IDs). Each particular content 
address directs to content accessible over the computer network. The routing 
server responds to the receipt of a content ED (which is essentially a request for 
content) by redirecting the request to a given content address corresponding to 
the given content ID. Additionally, the routing server may log information 
10 regarding the content request on a service access log maintained on a computer 
readable medium. 

In related embodiments, the interface system provides the user an encoded 
physical medium and a sensor. The encoded physical medium includes . an 
indirection hotspot having a content ID encoded therein. The sensor is operable 
15 to decode the content ID and then transmit the decoded content ID to a network 
device. In turn, the network device transmits the decoded content ID over the 
computer network to the routing server. 

In other related embodiments, the interface system also has a content 
server coupled with the routing server via the computer network. The content 
20 server stores the desired content identified by an entry in the database. It is 
contemplated that the content server can provide content directly to the network 
device. Alternatively, the content server can provide the content to the routing 
server which can log the transaction and then forward the content to the network 
device. 

25 A separate embodiment of the present invention teaches another interface 

system for providing content to a user. This interface system includes a computer 
system having a computer readable medium, an encoded physical medium, and a 
sensor. The encoded physical medium includes an indirection hotspot having an 
indirection encoded therein. The indirection designates a storage location on the 

30 computer readable medium and the storage location provides a computer 
instruction initiating the provision of content to the user. The sensor is operable 
both to decode the indirection encoded in the indirection hotspot and to transmit 
the decoded indirection to the computer system. 
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In related embodiments, the storage location on the computer readable 
medium provides an address to a computer document such as a word processing 
document, an audio file, a video file, or a graphics file. In these cases when the 
user engages the sensor with the indirection hotspot, the computer responds by 
invoking an application suitable for accessing the computer document. 

One aspect of the present invention teaches a method for providing a user 
content over a computer network such as the Internet. The method requires the 
steps of receiving at a routing web server a uniform resource locator (URL) 
identification number (ID) transmitted over the computer network by a web 
device, determining at the routing web server the URL that corresponds to the 
URL ID, redirecting the request for content to a content web server identified by 
the URL, and then providing the web device with the requested content. 

A related method involves several steps for generating the URL ID prior to 
transmission to the routing web server. These include measuring and decoding a 
hotspot present on an encoded physical medium (the hotspot has the URL ID 
encoded therein), transmitting the URL ID to the web device, and transmitting 
the URL ID from the web device to the routing web server over the computer 
network. Other possible steps include providing content to the web device either 
directly or through the routing web server, logging each request for content at the 
routing web server, and logging each occurrence of content being routed through 
the routing web server. 

The present invention therefore provides a more intuitive and richer 
metaphor for the interaction between humans and computerized systems, yet 
alleviates some of the encoding scheme demands placed upon the computer 
interface. These and other advantages of the present invention will become 
apparent upon reading the following detailed descriptions and studying the 
various figures of the drawings. 
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Brief Description of the Drawing s 



Figure 1 is a diagrammatic illustraticm of a computer interface in 
accordance with one embodiment of the present invention. 

5 Figure 2 is a flow chart illustrating one method for providing an interface 

between a user and a computer system in accordance with one aspect of the 
present invention. 

Figure 3 is a flow chart illustrating one suitable method for providing a 
user an encoded physical medium in accordance with another aspect of the 
10 present invention. 

Figure 4 is a diagrammatic illustration of a hot spot in accordance with one 
embodiment of the present invention. 

Figure 5 illustrates a sensor responsive to a first spectral encoding scheme 
in accordance with yet another embodiment of the present invention. 

15 Figure 6 is a flow chart illustrating one suitable method for measuring 

information encoded in a hot spot. 

Figure 7 is a diagrammatic illustration of a first data linked book 
embodiment of the present invention. 

Figure 8 is a diagrammatic illustration of a data linked globe embodiment 
20 of the present invention. 

Figure 9 is a diagrammatic illustration of an interface system for linking an 
encoded hotspot storing a URL ID with a corresponding URL. 

Figure 10 is a flowchart illustrating a method for providing user content 
indicated by a URL ID from a corresponding URL. 

25 
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Detailed Description of the Preferred Embodiments 

With reference to Figure 1, a computer interface 10 in accordance with one 
embodiment of the present invention will now be described. The interface 10 
includes a sensor 12 and an encoded physical medium 30. As will be apparent, 
the computer interface 10 provides an intuitive mechanism for a user to interface 
with and control an electronic device such as a computer system 40 (also 
illustrated in Figure 1). 

The encoded physical medium 30 has at least one region 32 wherein 
information has been encoded. The content of the region 32 may be encoded 
according to a well known content encoding scheme such as a bar code scheme. 
The present invention also teaches a variety of new encoding schemes. For 
example, a content encoding scheme contemplated by the present invention is a 
bar code printed using invisible, e.g. infrared (IR), inks. Such a bar code would 
be apparent to the sensor but invisible to the user. Alternatively, the content of 
the region 32 may be encoded according to a spectral encoding scheme. One 
specific example of a suitable spectral encoding scheme is described below with 
reference to Figures 4-6. The encoded physical medium 30 may also include a 
document identification (ID) hotspot 33, similar to the region 32. The content 
encoded within the document ID hotspot 33 will, however, be special in that it 
provides an indication of the identity of the particular encoded physical medium 
30. 

In certain embodiments, encoded regions such as the region 32 further 
include a marker 34 indicating that certain encoded information is present in the 
region 32. By way of example, in one spectral encoding scheme, the desired 
content for the region 32 is represented according to different visible and infrared 
inks (reflective and/or photoluminescent) applied to the region 32. The marker 
34 is represented by yet another infrared ink similarly applied to the region 34. 
In this example, the user would not see the marker 34, but may or may not see a 
visual representation of the content encoded in the region 32. Throughout the 
specification, markers, hotspots, regions, inks, etc., are often described as being 
able to generate light. Being able to "generate light" is defined herein as 
including at least one of the ability to reflect or emit light. 
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The encoded physical medium 30 may take any suitable form. By way of 
example, the encoded physical medium 30 may be a page from a physical book 
or magazine, an article of clothing such as a T-shirt, a globe, consumer product 
packaging, etc. Such encoded physical mediums may have been marked and 
5 encoded with data for the specific purpose of providing the interface of the 
present invention. Alternatively, the encoded physical medium 30 may simply be 
items selected from a user's surroundings, the encoded information arising 
randomly or unintentionally (at least with relation to the user's application). In 
another embodiment, the encoded content arises randomly or unintentionally, but 
10 a marker 34 is applied intentionally. Some representative examples of encoded 
physical mediums are described below with reference to Figures 7-8. 

The sensor 12 includes a sensing element 13, a decoder 14, a transceiver 
16, an on/off switch 18, and memory 20. The sensing element 13 is arranged to 
measure information present on the encoded physical medium 30. When the 

15 utilized encoding scheme implements a marker 34, the decoder 14 is arranged to 
determine whether the marker 34 is present in measured information, and when 
the marker 34 is sensed, to decode the measured information. The transceiver 16 
is operable to transmit data such as decoded information to the computer system 
40. Depending upon the embodiment, the transceiver 16 may establish either a 

20 uni -directional or bi-directional communications link 22 between the interface 10 
and the computer system 40. The communications link 22 is preferably a 
wireless communications link such as one based upon infrared (IR), radio- 
frequency (RF), or ultrasonic communications technology. However, the 
communications link 22 may take the form of a wired communications link such 

25 as a serial RS-232 or RS-485 data cable, or a parallel data cable. 

In some embodiments, the sensor 12 operates by measuring information 
selected from the encoded physical medium 30 by the user, decoding as 
necessary, and then transmitting the decoded information to the computer system 
40 for further processing. In other embodiments, the sensor 12 includes further 
30 hardware for processing the measured information locally. For example, the 
sensor 12 may include a microcontroller such as a PIC microcontroller 
programmed to process the measured information. The decoder 14 may be part 
of the microcontroller, or may be separate circuitry. In some embodiments, the 
sensor 12 maintains in the memory 20 a database related to the measured 
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infonnation. The information stored in the database may be used locally at the 
sensor and/or saved for subsequent transmission. 

The computer system 40 appears in Figure 1 as a personal desktop 
computer. However, it is contemplated that the interface 10 is suitable for use 
with a wide scope of electronic devices. The wide scope of suitable computer 
systems encompasses all types of personal computers, interactive TV systems, 
set-top boxes, web interfaces, haptic interfaces, streaming music and video 
sources, and many others. One particular example is a WebTV "net-top box." 
Further, although the interface 10 is intended to be representative of and thus 
generic to a broad range of interfaces contemplated by the present invention, it 
will be appreciated that computer interfaces of the present invention may take 
many forms which go beyond the example interface 10 of Figure L 

With reference to Figure 2, a method 100 for providing an interface 
between a user and a computer system in accordance with one aspect of the 
present invention will now be described. An initial step 102 provides the user 
with an encoded physical medium 30 and a sensor 12 suitable for sensing 
information present within the encoded physical medium 30. As described 
above, the encoded physical medium 30 may take any suitable form. One 
suitable method for performing the step 102 is described in more detail below 
with reference to Figure 3. 

In a next step 104, the user explores the encoded physical medium 30 and 
selects a desired portion 32 of the encoded physical medium 30. The user may be 
drawn into the desired portion 32 through text, coloring, or graphics illustrated on 
the desired portion 32. The text, coloring or graphics illustrated on the desired 
portion 32 may represent the encoded information, may be in addition to the 
encoded information, or may be some suitable combination of illustration and 
encoded information. Instead of being drawn in, perhaps in the case of a game or 
work task, the user may be selecting the desired portion 32 based upon some 
predefined criteria. For example, the user may be searching for a clue to a puzzle 
game, or simply doing inventory and selecting a bar code found on a product 
during this process. In any event, once the user has selected the desired portion 
32 in step 104, in a step 106 the user engages the sensor 12 with the desired 
portion 32 of the encoded physical medium 30. The sensor engagement of step 
106 will typically involve the user setting the sensor 12 to an ON state that 
indicates that the sensor 12 should be in operation. In the case of the interface 10 
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of Figure 1, the step 106 would involve operation of the on/off switch 18. 
Depending upon the particular sensor and the application, sensor engagement 
may require the user to bring the sensor 12 into close proximity to or in contact 
with the desired region 32. 

In a next step 108, the sensor 12 measures information present within the 
desired region 32 of the encoded physical medium 30. Information is defined 
herein as any data that the sensor 12 is capable of measuring. Thus, the 
information measured by the sensor 12 is not limited to information that has been 
purposefully encoded into the desired region 32 of the encoded physical medium 
30. 

A step 110 then determines whether the measured information has null 
meaning. When step 110 determines that the measured information has null 
meaning, it is simply determining that the measured information has not been 
marked, for the present purposes, as containing encoded information. However, 
as will be appreciated, a determination of null meaning may be consequential. 
Accordingly, when step 110 determines that the measured information has null 
meaning, a step 112 performs any action indicated by such a determination. For 
example, the sensor 12 may be equipped with a light that blinks or a buzzer that 
sounds when the measured information has null meaning. As another example, 
the sensor 12 may have memory 20 that is utilized to keep track of the meaning 
of the different measured regions, including each null determination. 
Alternatively, the null information may be transmitted to the computer system 40. 
In any event, once step 1 12 is complete, the control of the method 100 is passed 
back to step 104 allowing the user to explore further and select another region 32 
for sensing. 

When it is determined in step 110 that the information measured in step 
108 does not have null meaning (e.g., the measured information has been marked 
as containing encoded information), control is passed to a step 1 14 wherein the 
sensor 12 interprets the measured information. Depending upon the specific 
application, step 114 may involve just decoding of the information from the 
particular encoding scheme into a data format suitable for transmission by the 
transceiver 16. However, in some embodiments significant processing of the 
measured information will occur locally at the sensor 12. Thus in a next step 
116, the sensor 12 performs an operation that is a function of both the 
information interpreted in the step 114 and the context in which the information 

10 



WO 99/39277 



PCT/US98/24572 



was measured. Note that context depends upon the particular application and 
may include the nature of previously interpreted information, the timing of the 
user's engagement of the sensor 12, information received at the sensor from the 
computer system 40, etc. 

For example, with each new engagement of the sensor 12, the sensor 12 
may store the interpreted information in a database in the memory 20 and then 
evaluate the database or a portion of it to determine whether a predefined 
condition has been satisfied. A predefined condition could be the user gathering 
a set number of clues or data points, at which point the sensor transmits all or 
some of the stored information to the computer system 40. In one specific 
example, the user may be perusing an encoded catalog magazine 30 with a hand- 
held wand sensor 12. As the user engages the wand sensor 12 with regions of the 
catalog 30 representing desired products, these regions are sensed and the 
information therein interpreted by the wand sensor 12. When finished, the user 
may select an order region 32 indicating to the sensor that the user is ready to 
order and purchase the selected items. At this point, the communication link 22 
could be established with the computer system 40, which may be local or remote, 
and the user's order information could be transmitted to the computer system 40 
which in turn could process the order or further transmit the order as necessary. 

In other embodiments, the indicated action of step 116 includes the 
computer system 40 and/or the sensor 12 responding to the measured information 
by providing feedback. The feedback could take any suitable form such as audio, 
visual or tactile feedback. In any event, once the indicated action has been 
performed in the step 116, the control of the method 100 is passed back to step 
104 allowing the user to further explore the encoded physical medium 30 and 
select other regions for sensing. 

As noted above with reference to Figure 1, certain encoded physical 
mediums 30 include a document ID hot spot 33. In these embodiments, when a 
user first begins exploring the encoded physical medium 30 as described in step 
104, the initial step 106 ought to be the engagement of the sensor 12 with the 
document ID hot spot 33. Then in steps 1 14-1 16, the sensor 12 could store the 
document ID for later use, or immediately transmit it to the computer system, or 
both; it depends upon the specific application. For example, it is contemplated 
that the sensor 12 store the document ID and include it with content decoded 
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from each subsequently measured region prior to further processing of the 
decoded content. 

Further, certain encoding schemes may not require the use of a marker. 
Within these schemes, steps 110 and 1 12 of Figure 2 would become unnecessary, 
and thus another method for providing an interface using an encoding scheme 
without a marker could be implemented by simply skipping directly from step 
108 to step 1 14 of Figure 2. 

Turning next to Figure 3, a method 102 for providing a user an encoded 
physical medium 30 in accordance with another aspect of the present invention 
will be described. In a first step 200, the designer creates a representation of a 
physical medium 30 that will include hot spots. A "hot spot" is defined as a 
particular region wherein content is encoded, and may include text and/or 
graphics. The encoded content of the hot spot can take any of a variety of forms, 
dependent upon such things as the encoding scheme and the goals of the 
designer. For example, the encoding scheme may be such that the encoded 
content visually blends together with any text and graphics generated by the 
designer. Alternatively, the encoding scheme may result in the encoded content 
being visually distinctive or completely hidden from the viewer. The 
representation of the physical medium 30 may be created within an off-the-shelf 
or custom made design software system, or the representation may be a physical 
model. In a step 202, the designer defines the content of the hot spots. 
Alternatively, the designer may be provided with the content. The content of a 
hot spot is the information to be encoded therein, and may include computer 
instructions, a uniform resource locator (URL), and other data. 

In a subsequent step 204, the content of each hot spot is encoded according 
to a particular encoding scheme. Preferably, the encoding will be automated such 
that the designer will simply enter the desired content and initiate the encoding 
process, which is in turn performed by a computer system or some other suitably 
programmed tool. In some embodiments, the encoding process will also 
introduce a marker into the encoded content indicating that certain information is 
encoded in the hot spots. Once the content is encoded, in a step 206 the encoded 
content is inserted into the appropriate locations within the representation of the 
physical medium 30. In a step 208, the encoded physical medium 30 is generated 
from its representation. For example, when the representation is created by a 
system such as graphic design software and the encoding scheme is a spectral 
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encoding scheme, a printer utilizing the necessary inks can print out the encoded 
physical medium 30. 

With reference to Figures 4-6, a first spectral encoding scheme according 
to another embodiment of the present invention will be described. The first 
spectral encoding scheme represents content via three different values encoded 
within a hot spot 220. The sensor "decodes" these values by measuring the 
intensities of three different encoding colors CI, C2, and C3 found within the hot 
spot 220. CI, C2, and C3 may, for example, correspond to red, green, and blue 
(RGB). Alternatively, CI, C2, and C3 may be selected from outside the visible 
light range (e.g., infrared colors) or may be a combination of visible and invisible 
colors. 

As will be apparent to those skilled in the art, the hot spot 220 itself can be 
created using inks whose colors do not correspond directly to CI, C2 S and C3. 
Take the instance where CI, C2, and C3 correspond to RGB. Most likely, the 
color printing system selected to produce the hot spot 220 will be a "CMYK" 
type using cyan (C), magenta (M), yellow (Y), and black (K) inks to produce 
color images. In such a case, the encoded medium designer may be provided a 
mapping between CMYK space and the different content values, even though the 
sensor will be determining each content value by measuring the intensities of the 
three different encoding colors RGB within the hot spot 220. 

Figure 4 represents diagrammatically a hot spot 220 encoded according to 
the first spectral encoding scheme. A pie chart 222 indicates that the different 
encoding colors CI, C2, and C3 are measurable in the hot spot 220, each taking 
on their own particular intensity. Thus the engaged sensor would measure three 
different values, one each for CI, C2, and C3. These values taken together 
provide the encoded content. Figure 4 does not illustrate the visual appearance a 
hot spot would likely take on, but merely represents that the different encoding 
colors are measurable within the hot spot 220. Of course, depending upon the 
content encoded therein, each hot spot will have varying intensity levels and in 
some instances the intensity level of certain encoding colors would be zero. The 
actual visual appearance of the hot spot 220 would include any text and/or 
graphical illustrations that the designer has created. 

Figure 5 illustrates a sensor 300 responsive to the first spectral encoding 
scheme and thus operable to measure information from an encoded physical 
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medium 30. The sensor 300 includes a light emitter 302, a sensing element 304, 
and a shroud 306. The light emitter 302 includes three light emitting diodes 
LED1, LED2, and LED3, each operable to emit light corresponding to CI, C2, 
and C3, respectively. The sensing element 304 is a broadband sensing element 
responsive to the entire light spectrum. A user engages the sensor 300 with a 
desired region 32 of the encoded physical medium 30 by turning the sensor 300 
on and bringing the light emitter 302 and the sensing element 304 into reasonably 
close proximity to the desired region 32. When the sensor 300 is properly 
engaged with the desired region 32, the shroud 306 helps prevent the sensing 
element 304 from measuring extraneous information in the form of ambient light. 

With reference to Figure 6, one suitable method 108 for measuring the 
information stored within the desired region 32 will now be described. Simply 
put, the method 108 of Figure 6 sequences through measuring the intensities of 
the encoding colors CI, C2, and C3. In a first step 320, the user engages the 
sensor 300 with the desired region 32. A step 322 turns LED1 on, measures the 
reflected intensity of CI, and then turns LED1 off. A step 324 turns LED2 on, 
measures the reflected intensity of C2, and then turns LED2 off. A step 326 turns 
LED3 on, measures the reflected intensity of C3, and then turns LED3 off. 
Typically the sensing element 304 will generate an analog voltage proportional to 
the light intensity and the sensor 300 will include an analog-to-digital (A/D) 
converter. Thus the number of content identification numbers available with the 
first encoding scheme is directly dependent upon the precision of the A/D 
converter. 

Turning next to Figure 7, a data linked book 350 in accordance with one 
embodiment of the present invention will now be described. A primary purpose 
of the linked book 350 is to link a physical book with data such as video and 
audio streams available via an information network such as the Internet. The 
linked data is then presented (e.g., displayed, played, etc.) on an Internet device 
such as a WebTV or a personal computer. 

The linked book 350 includes a physical book 352, a sensor 353 having an 
infrared transmitter 354, a plurality of pages such as page 356 and a plurality of 
hot spots such as hot spots 358, 360, and 362. The physical book 352 appears 
conventional to a viewer in that the book 352 flips open to the different pages, 
each of which provide meaningful information in the form of text and graphics. 
In the example of Figure 7, the physical book 352 is opened to the page 356 
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entitled "Weather Report." Thus the user should immediately realize that the 
Weather Report page 356 is electronically linked to weather report information 
available over the corresponding information network. In the embodiment of 
Figure 7, each of the hot spots represents a uniform resource locator (URL). As 
will be appreciated, a URL is the addressing mechanism used by the Internet to 
correspond to a unique Internet address. A URL, together with any other desired 
information, is encoded within each hot spot according to a selected encoding 
scheme such as a spectral encoding or bar code scheme. 

When the user engages the sensor 353 with a desired hot spot, the sensor 
353 decodes the content of the hot spot, performs any necessary interpretation 
and other local functions, and then transmits the URL to the computer system 
370. The computer system 370 then uses the URL and other received 
information to download the desired data from the Internet, presenting such data 
to the user in the proper form. For example, a video stream may be displayed on 
the computer screen of the computer system 370. 

Turning next to Figure 8, a data linked globe 400 in accordance with yet 
another embodiment of the present invention will now be described. The data 
linked globe 400 includes both a sensor 402 having an infrared transmitter 404 
and a plurality of hot spots 406. The data linked globe 400 of Figure 8 presents a 
spherical earth map. Encoded within the hot spots 406 are linking data. The 
linking data of Figure 8 may take any of a variety of suitable forms. For 
example, similar to the data linked book of Figure 8, the linking data may include 
a URL. Each hot spot may represent a town, region, province, country, etc. The 
associated URL may direct the computer system 420 to an Internet World Wide 
Web page produced, e.g., by the Chamber of Commerce for that town, region, 
etc. 

In an alternative embodiment, the computer system 420 of Figure 8 
maintains a database of geographical and/or historical data regarding the region 
represented by the hot spot. The linking data would then instruct the computer 
system 420 to present the corresponding information through the appropriate 
media interface, e.g., audio and video. In yet another embodiment, the linking 
data stored in each hot spot would contain the bulk of the content, the sensor 402 
simply transferring this content to the computer system 420 which would in turn 
present this information through the appropriate media interface. 
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As will be appreciated, any encoding scheme (including those described 
above) will have some practical upper limit on the quantity of data that may be 
encoded upon a physical medium. Accordingly, certain computer interface 
applications may require more data storage capability than is reasonably possible 
from known encoding schemes. For example, only a fraction of the available 
URLs could be encoded utilizing a standard bar code scheme. However, it would 
be exceedingly useful to implement a computer interface such as the data-linked 
book 350 described above yet somehow get beyond the limitation imposed by the 
selected encoding scheme. 

To address this problem, certain embodiments of the present invention 
teach encoding an indirection in a hot spot rather than encoding the actual content 
or the direct address of the actual content in the hot spot. As will be appreciated, 
an indirection is an address that designates the storage location of an item of data 
to be treated as the address of an operand, but not necessarily as its direct 
address. By way of example, reconsider Figure 8. The content encoded within a 
hot spot 406 on the data linked globe 400 may be an address of a given word 
processing document stored on the computer system 420. Engaging the sensor 
402 with the hot spot 406 would then result in starting up the appropriate word 
processor with the given word processing document. More generally, the content 
encoded within the hot spot 406 can be the address of a computer document 
stored on the computer system 420. The computer document could take any 
suitable form such as a graphics file, an audio file, a video file, or a word 
processing document. Then, engaging the sensor 402 with the hot spot 406 
would invoke a suitable application for utilizing or accessing the computer 
document. Additionally, the suitable application may execute directly on the 
computer system 420, or remotely across a computer network coupled with the 
computer system. As will be appreciated, encoding an indirection within the hot 
spots greatly expands the amount of data which can be accessed using the present 
invention. 

Turning next to Figure 9, an interface system 500 for linking a hotspot 
identification (ID) to a particular URL in accordance with yet another 
embodiment of the present invention will be described. The interface system 500 
enables greater capability by storing at a linking web server hotspot IDs mapped 
to corresponding URLs. Thus, each hotspot need only have a URL ID encoded 
therein, and the routing web service can link each request to the proper content 
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web server. This enables a hotspot to indirect to a URL (or any other resource 
address) than cannot suitably be stored by the particular encoding scheme, yet 
can be suitably identified by a URL ID. 

To accomplish this, the interface system 500 includes an encoded physical 
medium 510, a wand sensor 512, a web device 514, a routing web server 516, at 
least one other web server such as a content web server 518, and a computer 
network 520 such as the Internet. The encoded physical medium 510 includes a 
plurality of hotspots 530. Each hotspot 530 has certain information encoded 
therein including a particular URL ID. The sensor 512 is operable to decode the 
certain information present in each hotspot 530 and transmit the decoded certain 
information to the web device 514. The web device 514 in turn is operable to 
forward the particular URL ID to the routing web server 516 of the computer 
network 520. The location or URL of the routing web server 516 may be 
encoded in the hotspot 530, added into the decoded certain information by the 
wand sensor 512 prior to transmission to the web device, or provided by the web 
device 514. As will be appreciated, the web device 514 may be any suitable 
mechanism such as a set-top web device, a personal computer, etc. 

The routing web server 516 includes a computer readable medium 540 
wherein the routing web server 516 maintains a web page database 542 and a 
service access log 544. The web page database 542 provides a correspondence 
between the various URL IDs and the "real" content web pages such as content 
web pages 550 found on the content web server 518. Within the service access 
log 544 the routing web server 516 logs every wand sensor access. The 
information in the service access log 544 can be utilized for billing, developing 
customer data, etc. 

With reference to Figure 10, a method 600 for linking the user with the 
proper URL will now be described. In an initial step 602, the wand sensor 512 
decodes the certain encoded information measured from a selected hotspot 530. 
In a next step 604, the wand sensor 604 performs any translation of the certain 
decoded data necessary and transmits the translated data to the web device 5 14. 
The translation may involve, e.g., attaching the URL of the routing web server 
516 to a decoded URL ID and marshaling the certain decoded data into a format 
suitable for transmission. 



17 



WO 99/39277 



PCT/US98/24572 



Once the web device 514 receives the URL ID, in a step 606 the web 
device 514 transmits the URL ED over the Internet to the routing web server 516. 
The transmission step 606 is essentially a request for content. Upon receipt of 
the URL ID, in a step 608 the routing web server 516 logs the access within the 
service access log 544 for later or immediate use in performing billing, tracking, 
etc. Then in a step 610, the routing web server 516 utilizes the web page 
database 542 to redirect the web device's content request to the corresponding 
web page provided by the content web server 518. In response, in a step 612, the 
content web server 518 provides the indicated content to the web device 514. 
The indicated content may be provided to the web device 514 directly over the 
Internet, or may be redirected through the routing web server 516 for additional 
tracking, etc. 

As will be appreciated, the interface system 500 of Figure 9 is not limited 
to the particular Internet application described above. For example, those skilled 
in the art will understand that the principles described above are well suited for 
use in providing content over a variety of different network formats; particularly 
they are not limited to web pages and the Internet. Hence, in more general terms, 
it is contemplated that the interface system 500 has a network device (instead of a 
web device), a routing server (instead of a routing web server), and a content 
server (instead of a content web server). Additionally, the interface system 500 
may be designed such that the web device 514 has the databases necessary for 
interpreting content requests and directly forwarding them to the content server. 
In such an embodiment, the routing server would not be necessary. 

While this invention has been described in terms of several preferred 
embodiments and a number of specific examples, there are alterations, 
permutations, and equivalents which fall within the scope of this invention. 

As will be appreciated, the variety of physical medium upon which content 
may be encoded according to the present invention is almost limitless, ranging 
from toys to tools to industrial parts and beyond. Still further, the hot spots may 
be encoded regions displayed upon a computer monitor, television screen, or the 
like. 

Likewise, the nature of content that may be encoded in the hot spots is 
unconstrained. The content may be abstract or concrete. A concrete example 
arises in the case of industrial parts where the encoding could be both machine 
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and Iiuman readable and geared towards assisting in an automated training 
system; Under the training system, the worker checks the code on the part to 
determine the correct assembly order or obtain other information about the part. 
Thus, with training, the worker would need to use the sensor only when she 
encounters a code that she is unfamiliar with. 

In certain applications, the nature of the content encoded within different 
hotspots varies. For example, a particular encoded physical medium may have a 
plurality of different types of hotspots such as indirection hotspots, direct content 
hotspots, and a document ID hotspot. Indirection hotspots have indirections 
encoded therein and thus once decoded, a mapping from the indirection to the 
desired content must be performed. Direct content hotspots are encoded with 
either direct addresses of the desired content or the desired content itself. The 
document ID hotspot provides an indication of the identity of the encoded 
physical medium. 

It is further contemplated that the sensor may take many different forms. 
For example, rather than a wand or portable sensing device, the sensor may be a 
stationary device where the encoded object is passed under or near the stationary 
sensor in order to cause engagement. 

Therefore it is desired that the appended claims be interpreted as including 
all such alterations, permutations, and equivalents as fall within the true spirit and 
scope of the present invention. 
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What is claimed is: 



CLAIMS 

1 . An interface system for providing content to a user via a computer 
network, the interface system comprising a routing server, the routing server 
including a computer readable medium having a database maintained by the 
routing server, the database storing entries each comprising a content address and 
a content identification number (ID), each content ID corresponding to a 
particular content address, each particular content address directing to a particular 
content accessible over the computer network, wherein the routing server 
responds to a request for content in the form of a given content ID by redirecting 
the request for content to a given content address corresponding to the given 
content ID. 



2. An interface system as recited in claim 1 wherein the computer 
readable medium further has a service access log maintained by the routing 
server, the service access log storing information regarding content requests. 



3. An interface system as recited in claim 1 further comprising: 

an encoded physical medium including an indirection hotspot having a 
content ID encoded therein; and 

a sensor operable for decoding the content ID encoded within the 
indirection hotspot 



4. An interface system as recited in claim 3 wherein the sensor is 
operable to transmit the decoded content ID, the interface system further 
comprising a network device capable of receiving the decoded content ID and 
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transmitting the decoded content ID over the computer network to the routing 
server. 



5. An interface system as recited in claim 4 wherein the computer 
network includes the Internet, an entry in the database corresponds to a web page, 
and the entry's content address includes a uniform resource locator (URL) for the 
web page. 



6. An interface system as recited in claim 4 further comprising a 
content server coupled with the routing server via the computer network, the 
content server storing content identified by an entry in the database, the content 
server operable to provide content to the network device. 



7. An interface system as recited in claim 3 wherein the encoded 
physical medium further includes a document identification hotspot having an 
indication of identity for the encoded physical medium encoded therein, the 
sensor operable for decoding the indication of identity for the encoded physical 
medium. 



8. An interface system as recited in claim 3 wherein the indirection 
hotspot is one of a plurality of indirection hotspots formed on the encoded 
physical medium. 



9. An interface system as recited in claim 3 wherein the indirection 
hotspot is one of a plurality of hotspots formed on the encoded physical medium, 
and at least one of the plurality of hotspots has information other than a content 
ID encoded therein. 
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10. An interface system as recited in claim 3 wherein the encoded 
physical medium includes at least one page having text and graphics. 



11. An interface system as recited in claim 3 wherein the encoded 
physical medium is a spherical object. 



12. An interface system as recited in claim 3 wherein the encoded 
physical medium is an article of apparel. 



13. An interface system as recited in claim 3 wherein the encoded 
physical medium is packaging material. 



14. An interface system as recited in claim 1 further including a content 
server coupled with the routing server via the computer network, the content 
server storing content identified by an entry in the database, the content server 
operable to provide content to the network device. 



15. An interface system as recited in claim 1 wherein an entry in the 
database corresponds to a web page, the entry's content address including a 
uniform resource locator (URL) for the web page. 



16. An interface system for providing content to a user, the interface 
system comprising: 

a computer system having a computer readable medium; 

an encoded physical medium including an indirection hotspot having an 
indirection encoded therein, the indirection designating a storage location on the 
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computer readable medium, the storage location providing a computer instruction 
initiating the providing of content to the user; 

a sensor operable to decode the indirection encoded in the indirection 
hotspot, the sensor further operable to transmit the decoded indirection to the 
computer system. 



17. An interface system as recited in claim 16 wherein the storage 
location on the computer readable medium provides an address to a computer 
document. 



18. An interface system as recited in claim 17 wherein when the user 
engages the sensor with the indirection hotspot, the computer responds by 
invoking an application suitable for accessing the computer document. 



19. An interface system as recited in claim 18 wherein the application is 
executed on the computer system. 



20. An interface system as recited in claim 18 wherein the computer 
document is a word processing document and the application is a word processor 
suitable for viewing the word processing document. 



21. An interface system as recited in claim 17 wherein the computer 
document is a graphics file and the application is suitable for displaying the 
graphics file to the user. 



22. An interface system as recited in claim 17 wherein the computer 
document is an audio file and the application is operable to play the audio file 
thereby providing audio feedback to the user. 
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23. An interface system as recited in claim 17 wherein the computer 
document is an video file and the application is operable to play the video file 
thereby providing visual feedback to the user. 

5 

24. A method for providing a user content over a computer network, the 
method comprising the steps of: 

a) receiving at a routing web server a uniform resource locator (URL) 
identification number (ID) transmitted over the computer network by a 

10 web device, the receipt of the URL ID constituting receipt of a request 

for content available at a URL corresponding to the URL ID ; 

b) determining at the routing web server the URL that corresponds to the 
URL ID; 

c) redirecting the request for content to a content web server identified by 
15 the URL; and 

d) providing the web device with the requested content. 



25. A method for providing a user content as recited in claim 24, the 
method further comprising the following steps performed prior to steps a) - d): 

20 measuring and decoding a hotspot present on an encoded physical medium, 

the hotspot having the URL ID encoded therein; 

transmitting the URL ID to the web device; and 

transmitting the URL ID from the web device to the routing web server 
over the computer network; 

25 

26. A method as recited in claim 24 wherein the step of determining at 
the routing web server the identity of the URL that corresponds to the URL ID 
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includes the substep of searching for the URL ID entry in a database stored on 
the routing web server. 



27. A method as recited in claim 24 wherein the step of providing the 
web device with the requested content includes the substep of transmitting the 
content directly from the content web server to the web device. 



28. A method as recited in claim 24 wherein the step of providing the 
web device with the requested content includes the substep of transmitting the 
content indirectly from the content web server to the web device by routing the 
content through the routing web server. 



29. A method as recited in claim 24 further comprising the step of 
logging each request for content at the routing web server. 



30. A method as recited in claim 28 further comprising the step of 
logging each request for content at the routing web server. 



31. A method as recited in claim 28 further comprising the step of 
logging each occurrence of content being routed through the routing web server. 



25 



WO 99/39277 PCT/US98/24572 

1 /7 




Figure 1 



WO 99/39277 



PCT/US98/24572 



2/7 



100 



102' 



(sTAR^ 



PROVIDE USER WITH AN ENCODED 
PHYSICAL MEDIUM AND A SENSOR SUITABLE 
FOR SENSING INFORMATION PRESENT ON 
THE ENCODED PHYSICAL MEDIUM 



112 



2\. 



ir 



104 



USER EXPLORES THE ENCODED PHYSICAL 
MEDIUM AND SELECTS A DESIRED REGION 
OF THE ENCODED PHYSICAL MEDIUM 



106' 



USER ENGAGES THE SENSOR WITH 
THE DESIRED REGION OF THE 
ENCODED PHYSICAL MEDIUM 



108' 



SENSOR MEASURES INFORMATION PRESENT 
AT THE DESIRED REGION OF THE ENCODED 
PHYSICAL MEDIUM 



110- 



PERFORM ANY ACTION 
CORRESPONDING TO 
A NULL MEANING 




DOES THE MEASURED INFORMATION 
HAVE NULL MEA NING? 

NO 



114' 



SENSOR INTERPRETS 
MEASURED INFORMATION 



116' 



SENSOR PERFORMS ACTION INDICATED BY 
COMBINATION OF INTERPRETED 
INFORMATION AND CONTEXT 



Figure 2 



WO 99/39277 PCT/US98/24572 

3/7 



102 



200' 




DESIGNER CREATES REPRESENTATION OF 
PHYSICAL MEDIUM THAT WILL INCLUDE "HOT 
SPOTS" AND MAY INCLUDE TEXT AND/OR 
GRAPHICS 



202' 



204 



DEFINE CONTENT OF HOT SPOTS 




r 


ENCODE CONTEN 


IT OF HOT SPOTS 



206' 



INSERT ENCODED CONTENT INTO THE 
APPROPRIATE LOCATION(S) WITHIN THE 
REPRESENTATION OF THE PHYSICAL MEDIUM 



208' 



GENERATE AN ENCODED 
PHYSICAL MEDIUM FROM 
ITS REPRESENTATION 



( ^one ) 



Figure 3 



WO 99/39277 



PCT/US98/24572 



220 



4/7 



222 




108 



Figure 4 



300 



320' 




-30 



ENGAGE SENSOR WITH HOT SPOT 



322' 



324' 



326' 



TURN LED1 ON, MEASURE INTENSITY 
OF C1, TURN LED1 OFF 



I 



TURN LED2 ON, MEASURE INTENSITY 
OF C2, TURN LED2 OFF 



I 



TURN LED3 ON, MEASURE INTENSITY 
OF C3, TURN LED3 OFF 



~3~ 

(done) 

Figure 6 



WO 99/39277 PCT/US98/24572 

5 /7 




Figure 7 




Figure 8 




SUBSTITUTE SHEET (RULE 26) 



PCT/US98/24572 



7/7 



600 



602' 



604' 



(sTAR^ 



SENSOR DECODES CERTAIN ENCODED 
INFORMATION MEASURED FROM USER 
SELECTED HOTSPOT INCLUDING URL ID 



SENSOR PERFORMS ANY NECESSARY 
TRANSLATION OF CERTAIN DECODED DATA 
AND TRASMITS DATA TO WEB DEVICE 



606' 



WEB DEVICE TRANSMITS URL ID OUT 
OVER THE INTERNET TO THE 
ROUTING WEB SERVER 



608 



610' 



612' 



ROUTING WEB SERVER LOGS ACCESS FOR 
LATER OR IMMEDIATE USE IN ACTIONS 
SUCH AS BILLING, TRACKING, ETC. 



ROUTING WEB SERVER REDIRECTS THE WEB 
DEVICE TO THE CORRESPONDING WEB PAGE 
OF THE CONTENT WEB SERVER 



CONTENT WEB SERVER DELIVERS 
CONTENT TO THE WEB DEVICE 




DONE 



Figure 10 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US98/24572 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC(6) :G06P 15/163 

US CL : 395/200.47, 200.68; 707/10, 513 
According to International Patent Classification (IPC) or to both national classifi cation and IPC 

B. FIELDS SEARCHED 

Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 395/200.3 . 200.47. 200.48. 200.49. 200.68, 200.74; 7OT/10. 500. 513 

Documentation searched other than min i m um documentation to the extent that such documents are included in the fields searched 
Microsoft Press Computer Dictionary 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
APS, WEST. IEEE Electronic Library 

search terms: bar code, barcode, encoded device, sensor, URL, internet, www, global network, computer, workstation 



C. DOC 


rUMENTS CONSIDERED TO BE RELEVANT 


Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


X, P 

yTp 

A,E 
A.E 
A, E 
A 


US 5,804,803 A (CRAGUN et al.) 08 September 1998, col. 2, lines 
50-57, cols. 7-8 

US 5,848,413 A (WOLFF) 08 December 1998, abstract, col. 5 
(Figure 3) 

US 5,862,321 A (LAMMING et al.) 19 January 1999, abstract, 
Figure 7 

US 5,841,978 A (RHOADS) 24 November 1998, abstract, cols. 57- 
59, claims 

IBM Technical Disclosure Bulletin, vol. 35, No. 1A, June 1992, 
pages 315-318, "Portable Self-Checkout Retail System" 


1-31 

1-31 
1-31 
1-31 
1-31 


fx] Further documents are listed in the continuation of Box C. Q See patent family annex. 


Special categories of cited documenu: "T" Uter document published after the international filing date or priority 
■ A.' - document defining the general state of the art which is not considered !? t0 ™ d T ™ C ° nflict w ' lh 1 th « *PP»«»Uon but cited to understand 
to be of particular relevance 010 P™«pk or &*XY underlying the invention 

"E" earlier document published on or after the international tiling date document of particular relevance; the claimed invention cannot be 

considered novel or cannot be considered to involve an inventive step 
'L* document which may throw doubts on priority claiin(s) or which is when the document is taken alone 
cited to esublbh the publication date of another citation or other 

special reason (as specified) "Y" document of particular relevance; the claimed invention cannot be 

, - . . , , considered to involve an inventive step when the documont is 

O- document referring to an oral disclosure use, exh.bition or other combined with one or more other such documenu. such conTinaUoS 
mewlJ being obvious to a person skilled in the art 

*P" document published prior to the international filing date but later than j , , 

the prionty date claimed & document member of the same patent family 


Date of the actual completion of the international search 
03 FEBRUARY 1999 


Date of mailing of the international search report 

15 APR 1999 


Name and mailing address of the ISA/ US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703) 305-3230 


Authorized officer 

FRANK ASTA p^^P^S'^t^Z*^ 
Telephone No. (703) 305-3817 



Form PCT/ISA/210 (second sheet)(July 1992) *■ 



INTERNATIONAL SEARCJ^ ^REPORT 



International application No. 
PCT/US98/24572 



C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



\ 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



WO 98/03923 Al (KRAFTSOW et al.) 29 January 1998, abstract, 
pages 2-4 \ 



1-31 



\ 



\ 



\ 



Form PCT/ISA/210 (continuation of second sheet)(July 1992) * 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

}Q BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



